Papers with OOD detection methods
Classical Out-of-Distribution Detection Methods Benchmark in Text Classification Tasks (2023.acl-srw)
Copied to clipboard
| Challenge: | Current approaches to OOD detection in NLP are not yet sufficiently sensitive to capture all samples characterized by various types of distributional shifts. |
| Approach: | They evaluated eight methods that are easily integrable into existing NLP systems and require no additional OOD data or model modifications. |
| Outcome: | The proposed methods are easily integrable into existing NLP systems and require no additional OOD data or model modifications. |
DMHM: Density-aware Manifold Learning and Hybrid Mahalanobis Energy for LLMs-generated Text Detection (2026.acl-long)
Copied to clipboard
Tianle Liu, Zhiliang Tian, Zhen Huang, Tianlun Liu, Jingyuan Huang, Zhaoning Zhang, Chengcheng Shao, Dongsheng Li
| Challenge: | Existing methods for LGT detection assume that it is a single homogeneous distribution. |
| Approach: | They propose a framework for LGT detection based on density-aware manifold learning and hybrid Mahalanobis energy. |
| Outcome: | The proposed framework outperforms baselines in detecting LLM-generated text (LGT) it is based on density-aware manifold learning and hybrid Mahalanobis energy . |
A Critical Analysis of Document Out-of-Distribution Detection (2023.findings-emnlp)
Copied to clipboard
Jiuxiang Gu, Yifei Ming, Yi Zhou, Jason Kuen, Vlad Morariu, Handong Zhao, Ruiyi Zhang, Nikolaos Barmpalios, Anqi Liu, Yixuan Li, Tong Sun, Ani Nenkova
| Challenge: | Existing document understanding models focus on single-modal inputs such as images or texts. |
| Approach: | They propose to use a spatial-aware adapter to adapt transformer-based language models to document domain to exploit multi-modal information. |
| Outcome: | The proposed model significantly improves the OOD detection performance compared to using a standard language model and to competitive baselines. |
FLatS: Principled Out-of-Distribution Detection with Feature-Based Likelihood Ratio Score (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting out-of-distribution instances are empirical . state-of the-art methods for OOD detection are suboptimal since they only estimate in-distance density pout(x). |
| Approach: | They propose a method that measures the “OOD-ness” of a test case x through the likelihood ratio between out-distribution mathcal Pout and in-division mathcal Pin. |
| Outcome: | The proposed method improves existing methods on popular benchmarks and establishes a new SOTA on popular NLP benchmarks. |
VI-OOD: A Unified Framework of Representation Learning for Textual Out-of-distribution Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is a crucial part of deep neural networks. |
| Approach: | They propose a variational inference framework which maximizes the likelihood of the joint distribution p(x, y) instead of p[y|x). |
| Outcome: | The proposed framework maximizes the likelihood of the joint distribution p(x, y) instead of p[y|x). |